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ABSTRACT 

This issue provides abstracts and analyses, prepared^ 
by science educators, o£ reisearch reports in jbhree areas of • 
iTivestitetion> The first area is cognitive developaent. Three of the 
five stuaies presented in this area are Piagetian in naturp. , The 
second group contains four studies dealing with attitudes aad values. 
And the third area, auto-tutoriai instruction, .contains tfo studies 
dealing with biological sciences, one at the high school and one at 
the university Xevel. Bach abstract includes bibliographical data, 
research design and procedure, purpose, and research rationale, along 
vitli.the abstractor's analysis. (BB) 
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NOTES . 



frora the Editor 



^ • This issue of INVESTIGATIONS. IN SCIENCE EDUCATION contains tTiree 

clusters of research reports* TJie first cluster, COGNITIVE DEVELOPMENT* 

teflects a continued emphasis on Piagetian research.; Three of the five 

studies in this group are Piagetian in nature. . . ) ,s 

The second cluster bntains four studies dealing with ATTITUDES AND 
, ■ * . • ^ % 

VALUES, with two' of these studies being reviewed in a single critique- 

The final cluster^ AUTO-TUTORIAL INS^TRUCTION, contains' two studies, 
both dealing with biological sciences-, one at the high school and one 

c \ 

at the university level. 

We continue to encourage publishable responses to the analyses afnd' 



) 

invite suggestions for improvement of ^INVESTIGATIONS. IN SCIENCE EDUCATION 



Stanley L. Helgeson 
Editor. 



Patricia E. Blosser 
Associate Editor 
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^ Bred<Jerinan, Ted. "Elementary SchocSi- Science Experience and the Ability 
to Combine and Control Variables.'" Science Education , 58(4) :A57- 
469, 1974. ' . , . 

/Descriptors — '^Cognitive Development ; Curriculum; Educational 
Research; *Elementary School Science; Laboratory Experiment's; 
*Le;aming Theories; Science Education; ^Scier/tific Methodology; 
, Science Course Improvement Project ^ 

^ . • . 

Expanded abstract- and analysis prepared especially for I.S.E. by Anton E. 
Lawson, Arizona States University. . ' . • 



Purpose 



This study attempted to answer three questions with regard to the ability 



to combine and control variables: 



1. At what grade levels do children from upper middie class 

^- * , ■ • 

American communities develop these abilitljea?^ 

. 

Does the elementary' school science program, in the school they 
ate end produce a noticeable 'effect in this 'development? 



Is there a relationship between a^ child's' /ability to control 

It 



variables an^ his ability to form comblnatxon^ of variabl*^? 



Rationale ' \. ' s 

— — — : ^ ^ ; , . ' 

A trend ij^ recent years has be^n noted in whicl^ elepientary s^lei^e pro- 
grams such as Science — A Prpcess Approach have'^begxifat td ^m^asi:^ the 
Investigativ^jjfrocesses 'of .the scientist. * Tti^se i^vest?igative processes 
involve the abilities to combine and. cp^trol Variables^ These abilities 
have received" widespread attention in the science eduction and psychol- 
ogy literattire in recent years.' This interest can be traced to Inhelder 
'and Placet's 1958 volume yhe Growth of Logical Thinking from Childhood " 
to Adolescence in which*'^e coml^i^ation ^a^^control of variables play a 
central role in tlie 'developing "formal operational" reasoning of -the 
adolescent. . ' ' 



In Inhelder and P-iaget's theory of intellectual developInen^, formal .opera- 
tlonal^ reasoning repreisents the fourth and final .stage of 'development . < 
r Formal operational reasoning, which can be ^considered hypotheticb-deductive 
"scientific reasoairffe" is theoretically* dependent upon the prior develop- 
ment of concrete operational reasoning of the child.- Thus formal opera- 
tional reasoning is delayed in appearance in most persons u^tii adolescence. 
Further,* Inhelder and Piaget theorize that the development of the "combina- 
torial system" vhich allows the generation of all possible combinations of 
variables is necessary for the subject to devise controlled experiments and 
to prog^erly deduce *<:heir implications. , . • 



Research Design and Procedure 

DesigQ . The research desigii 'employ ed'^in this study is referred to by 
Campbell and Stanley (1963) as the one-shot case study de.sign. Subjects 
were taught science in one of three programs; •■(1) a noncoordinated science 
program, (2) a specialist-run laboratory program, a^d (3) the Science — A 
Process Approach program". Following science instruction in one of these 
three programs subjects were posttested xrtth measures; of their ability to-' 
combine variables and \o control variables. IQ sco^s, measured by the 
Otis Quick Scoring Mental Ability Test, were taken/ from school records. 

Subjects > Subjects were 240 childre^ in grades 4, 6, 8, and 10, A 
raadom sampla .of 20 subjects'" was chosen, from each of the^ three programs 
at each grade. * - ' 

t .V ■ > . . * • 

-f^ Procedure . The ability to combine variables and to cohtrol^variables 
was measured 'using; individual ta^ks aSainistered by^our trained examiners. 

Tasks . The combination of variables task apgcrsi^sted, in< presenting the / 
§ubject with pieces ''bf^ wooden non cdHsist'ing of" four" different pieces vary- 
ing in color of ^'s^es, trousers, : :ket and hat. In all, 16 d^.fferent men 
could be constructed^ Subject 3 were asked to generate as mai^ wooden men ^ 
as they could. Responses were scored into, one of seven categories reflect- - 
ijig the degree to which their approach was' systematic and complete.' 

: . V . • = ■ ' • • " •■ • 

The controV of variables task consisted of presenting the subject with two- 
Identical^ lever systems in which five independent variables affected the 
« 'AO..* 



distance the lever moved when a weight was placed at its end, Questions 

were posed in which the subject was asked to^test the effect of the inde- 

pendent variables. A numerical score'^ re flee ting the number of variables 

• • • • 

Jt. deliberately controlled was calculated* ' ^ 

Data Analysis v^ Subjects' abilitie^ to combine and control variables 
were compared with respect to grade level and elementary school sciet^e v 
programs using Chi-square and analysis of covariance techniques. Corre- 
lation coefficients (type not specified) were computed and reported among 
task responses, sex, grade level, age, IQ, and mental age. 



Findings , ' ^ 

^ The ability t± systematically generate combinations variables increased 

significantlt with age (p< 0.001) up to the eighth grade theji leveled off. 
The ability to control varl^gy/4s also increased significantly with age 
Cp<0.01). This increase w^^ evident between each age group with }no level- 
ing off between. the eighth and tenth grades. ^ ^ 

.No significant differences vereyobserved among the three different science 
programs on either tasic (p < O^v.05) '. - ^ . 

9 The ability to systematically combine. variables was .foxmd to be signifi- 
cantly relate^ to the ability to control variables (p< 0.00i). Nearly 
all subjects who could combine variables could also control variables. 
> , However,' tfiose who could combine variables m^y or may not have, been able 

to control varid^les. This rela^tionship•*was reversed when only subjects 
^ * wit^a higjily developed abilitjr to control variables were considered or 
^ ^ lAeJja all subjects were considered "and their control of variables responses 

were divided- Into non-perfect /and perfect *categ(^ries^ ^ 

\ ' The correlation analysis revealed moderate to' high intercorrelations among • 



the abilities- to combine and control variables, grade l^vel, age, IQ, and 
mental 'age. 
performance. 



mental age. By ^^and large, sex 'did not correlate significantly with task 
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Interpretations • 

The fbllowiiig conclusions were'' drawn: 

1. There is a significant improvement in' children's abilities to 
combine and control variables during the pre- and early adoles-^ 
cent years. - ' ' ^ 

2. These improvements do. not s^em to b^ noticeably affected by^ the 
science program used during the upper elementary grades. 

- . 3, The initial development of the control of variables ability ^ 
precedes that of combining variables but final mastery is^not 
achieved until the combinatoriSl ability has been acquired, 

r » - . 

t 

The development of the abilities of combining and controlling variables 
appears gradual and spans several years. Further, at. any one age the 
variability in performance is considerable. - ^ 

4 

On both tasks some fourth graders performed better than some tenth . 
graders. The .failure of subjects from the Science — A Process Approach 
program to perform better than the subjects from the other programs on • 
the combination and control of variables tasks was unexpected. This 
failure wa/^ttributed to lack of, transfer of learning.' 

\, ' "1 * . ^ A 

The third conclusion -is in ^^^ite close agreement with theoretical expec- 
tations based upon Piagetian theory which states that the expe^;?lfiental 
isolation of variables leads' to the combinatorial system which enables 
one to use propositional reasoning which in turn allows complete mastery 
of ^the control of variables procedure. . 



ABSTRACTOR'S ANALYSIS 

This research addresses fundamentally importaiit issues in education^ i.e, 
what reasoning processes develop or faB.<jto develop with age? And what 
can instruction (in this ^ case science instruction) do to facilitate- this 
development? c , 



/The findirTg that component of formal reasoning do develop with ng^ and 
'that a^wide range of pi^gfcrmance exists at any one age has been corrob- 
orated by a number of more recent studies . (e. g, , Lawson, ICarplus and Adi, 

^ • * - • 

In press; Martorano, 1977; Moshsian, 1977), . 

The issue of determining sequences of development of components of formal 
reasonings, in this case the development of the ability to combine varia- 
bles nVior to the^ development of the ability to contfol variables, is a 
verj di " "icult issue to deal with adequately. Such analyses are compli- 



cated by^ the fagt tljat logically equivalent tasks can vary in degree of 
difficulty dae -to logically irrelevant variables (e.g., Nummedal and 
Collea, 1978) thus making the quesjjion of which logical ability comes first 
difficult to determine. One would need to insure that variables such as 
task content and complexity were controlled. This was not the case in t^e 
Breddennan study. Recall the combinations item involved wooden men and 
colors of shoes, trousers, etc. wfiile the control of variables task invol- 
ved levers. It would have been better to have asked the "subjects to 
generate coni>inations of the variables involved in the lever task as well, 
as control of variables questions. Likewise the subjects could have be'en 
asked/control of variables questions with the wooden men as well as the 
combinations questions: Nevertheless, the fasks that were use^^appear ta 
be novel to the subjects and the variables involved were familiar enough 
to be understood so that the results may in fact not have been affected 
by the difference in content. See Lawson '(1978) for a more /complete ^s- 
cussion of. this issue. 



The conclusion that the Science — A Process Approach (S-APA) prbgjra]^! *drd 
not noticeably advance subjects' abilities to combine and control "varia- 
bles is of course regrettable. On the other hand. Linn and 'Thier (1975) 
reported that the Science Curriculum Improvement Study Cs6lS) program' dic^ 
have a not^iceable effect on advancing subjeet^s* ability to control varia- 
bles. Failure in one instance and success in the other cotlld be due to 
several factors, the programs themselves being just one possibility. 
Other possittilities include the adequacy with which each program was 
taught, the length of time devoted. to each program, .and of course' to the 
method of measj^ring student reasoning abilities. 



r ^ 



If, in fact, the improvement *in one. instance and lack of noticeable 
improvement in the' other can be attributed to .the superiority of the 
SCIS program, • this could be due to the fact that the SCIS program makes 
' every attempt to embed the logical reasoning within the context of the 
science- concepts being taught whereas the program does not. For 

ex:ample, SCIS class lessons are, designed to study environmental, factors,, 
energy sources, photosynthesis and so oh, "with the combination and con- 
trol of variables coming into play only yhen needed to understand such 
science concepts, . ' C 

9 

i 

The S-APA program, on the other hand, has Ijessons in which students 
explicitly study controlling variables, observing, measuring and the like, 
with the^ concepts of science 'relegated to a secondary role, this differ- 
ence may be significant in that the SCIS program's approach may be more • 
in tune with thef way logical reasoning "spont^eously" r^nifests itself 
with advancing age.-* Children^ are typically not directly taught to com- 
bine and/or control vari^tMLes outside^of school yet the evidencire clearly 
shows' that those logical abilities to develcTp . (at lea'&t ih many children)*. 

I believe that Bredderman's conjecture is essentially correct that the 
reason the S-APA program subjects failed "to outperform the othgr subjects 
was due ^ to a failure to tranter their learning. The Lawson an<f Wollman 
(1976) study clearly indicated 'that fifth and "seventh grade students of 
normal intelligence can acquire the ability to control variables in a 
relatively -short period of time. iQut do they use this ability once .it 
is acquired? ^ Does it transfer to new situations?" . 

. ■ ( . ■ - ■ 

The answer to these questions, I believe, is simply that it depends. . 

First o^f -all, it cfepends upon the way in which the ability was taught. / 

It must be taught* in such a way that if is connected' to the students' 
' - 
own intuit ions\ (intuitively connected). And it must be taught in such 

♦ ' > '~ 

a way that it is related to many external contexts, not just science 

contexts (contextually connected) . \' Further, it depends upon the sort 

of environment in which the student finds himself after the training-. 

If he returns to an environment in which the newly acqtSired ability is^ 

not needed (i.e., an authoritarian* environment in which questions are 

'.not raised and evidence is not sought to test tentative answers to thesfe 

quesftions), the ahJLlity will atrophy from disuse. However,- if He returns 



to an,envir6nme^:it: ±n which tli^^wly Required reasoning ability is 
. demanded, it x^li be further 'sTiajrpened 'and re'fihed. ■ Transfer will 
be effected, * . ' * . .iS^* ■ " • ' * V 



The- successful • program then mis.t^ be.more' than a prografa in reaspning 
in science ^ The program must be^iiv-wdth examples^ f torn the students' 
own experience and it must ^continue with exan^les outside of the con- 
text, of science. Further it may be necessary that many -courses (not * 
•just the science course) create situations in i^ich answers to questions 
are "actively sought and- tested. ' <' 

- ■• .■ ■ " ^ ' ./ 

The Bredderman study is a valid and worthwhile initial, attempt to deter- 
mine the effectiveness. of a science program on the development of j 
reasoning of students. It clearly points out the magnitude of the 
task at hand, y * • 

An extremely important, direction for- future research is in testing 
various hypotheses concerning, methods of teaching logical reasoning 
and variables affecting the transfer of such teaching. 
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Purpbse .w^vA'\.*V- 

The principal objective of the research xjais\ t^'c^prbduc^ workable group 

forms of Pijlgetian tasks ♦ the report^ ife^a description of an attempt to 

' ■ • ' " '^'^ . 

transLate'^two Piagetian-type problem situations ihtt) forms suitable for 

* '. . • ' 

acbninist ration to groups, " together witdi markin^^chemes, and a report 

■ . -• ■ ' , ■ ' ' - • ^ ■ 

and discussion of thq results of their experimental tri^. 

Rationale ' ' 



X 



In 1,966 Bruner maintained that , mental growth was essentially jiiscontin- 
uous and therefore .best described by stage developmental! theories rather 
than theories postulating graidixal accretion processes. The st:age develop- 
ment viewpoint, particularly in the form proposed by Piaget', has gained a 



steadily increasing importance in the thinking^f educators. A number of; 
attempts have been mad^ to construct school science^curricu-^a fitted to 
developmental levels and to analyze existing courses the x^me terms. ^ 
Examples of thesfe. attempts are the "AustraldLan Sciencekigduj^ation Proje?tr' 
an4, in4|lftEtain, the "Schools Councm 5/13 Project.'*^ Iiigle and Shayer, , . 
In^a seri^.of articles, have described a teclmique for assessing science; 
courses based on Piaget's develpptoenj:al stages, and have demonstrated its 
usefulness by providing a close analysis- in these t6rms of the Nuffield 
O-level courses in 'chemistry and phjtsics.' 

While attempts to adapt curricula to the developmental levels of tKe 
Intended population must, be-^ applauded as an important step in improving * 
the quality 65 our educational Systeffl, the problem still remains for the 
teacher — how to identify the mental development af child who faces < 

him.; Shayer has suggested -the indirect method of utilizing mental age 



as a predictor of stage of inent4l development. 'Since individually admin- 
.istered type examples, as- discussed by Inheldet and Piaget, are 
prohibitively time consuming for use in the normal classroom situation, 
this-study is an attempt to translate two Piagetian-type pi;pblein .situa- 
tions'-into forms suitable for .administration to gropps, ■ ' 



Research be sign- and Procedure ^^^'^ ^ 

— — r — 

• The principal objective of the research reported here was^ to produce work- 
able group forms of Piagetian tasks. The tasks selected for this study 
were (1) Tiie Chemical Colo^ Chatxge Problem and (2) The Pendultam^ Problem. 
TheNf esearchers wanted a chemical task and a physical one that were struc- 
turally similar but which involved very different subject matter; ^ This 
was desired in oriSer to test the hypothesis that a particular quality of 
thou^t demonstrated in the subject area tends tfo be- demonstrated with 
problems possessing a similar structure in another sub-ject area. 

Essentially, the students composing the saiq>le' for the. study were given a 
set of materials, instructions and work sheets arid they were asked to com- 
plete the task as described in the instructions. ' Tl(ere were two work 
sheets following the initial page of instruct ipna for each task. The 
first work sheet was designed for the student .J:6 record his physical manip- 
ulations of the apparatus. The second work "sheet asked for a, summary of 
,what had been found out -in the experiment, ^ 

The sample for ^his. study consisted of -a total of 193 students (110 boys and 
83 j^irls) - who psirticipated in the chemical /^periment; 189 of the same 
students (107 boys and 82 girls) participated in the pendulum experiment. 

students were selected from* a South Australian metropolitan high 0 
school and represented^ each of the first four years of the high: school 
with the exception of the first year, where there is a ^random assignment 
^to classes.* Students at the school are streamed by ability; therefore, a 
.wid*e range, of abilities T»as insured by selecting sections at various * 
levels. , ' . ' 

The sjpheme for analyzing the restilts was, insofar as possible, in accord- 
ance with the schemes proposed by Inhelder and Piaget. This involved 



placing children in two- subcategories*, A and B, . o£^ each' of the two major 
categories of mental development being considered— concrete CII) and 
formal (HI). * ' ^" 

. . I y. . , . _ ■ , , . ■ ^ V<j 

f . • • . , . ■ 

*" *. - ■'.*"■ 

' • * ' ' ' " 

The inter-judge reliabilities obtained from categories given independently 
"-. by each of the two a^uthors and expressed as product moment correlation" co- 
efficients (r) were: chemical t^st r = 0,9"6, 'SE = 0.006^ and pendulum test 
f = 0.92, SE = 0.011. ^ : \ . ' , 



Findings ■ - - 

The data were presented as frequency and percent of subjects' responses 
falling, into two levels each ctf ^-the concrete and^ formal developmental 
levels. Data from --both problems clearly showed the dual trends, of 
increase.- in percentage of formal thinkers with increase in chronological * 
age and 'the higher percentage of formal thinker^ in the upper stream at 
the various grade levels. The degree to which the two problems provided 
the same measure of developmental sublevel,' expressed^ as a product moment, 
correlation coefficient, was r .= S^E. = 0.05. 



Interpretations 



According to the researchers, the major conclxision xdiich emerges from this 

. • • > ■ • .• . • 

study is the fact that it does seem ^possible to translate into jgroup form, 

administer, and assess rapidly with c'onsiderable reliability Piagetian- 
tyi^e ptoblem indicators of development level. Of secondary importance and 
provided only as comments by the researchers, the results .^suggest that (l) 
the pendulum problem provided an eatlier indication of •the' onset of formal 
thinking ^than did the chemical one,, and (2) altfiougji having carried out 
the pendulum experiment only two weeks befoxe' the testing report^ed here 
in a teaching situation, a substantial number of students from second 
and third year classes of intermediate ability level gave-^ concrete opera- 
tional level answers to the problem. This brings into question what is \ 
achieveH by the attempted teaching of content which, in developmental terms, 
is beyond the grasp of those performing the exercise. 



ABSTRACTOR' S- ANALYSIS . ' ■ 

■ • ^ • • . . * * . ; ^ ' . * 

>- . • . t • - • ; . ^ . - 

The purpose arid the procedures ujsed in this %ivesrtigat ion are rather- unique 
This uniqueness oomplicated the efforts, of this abstractor to construct an 
expanded abstract for Investigations in Science Education ^ as per the 
suggested format. . 0 i 

The researchers identified a* very practical problem and have attempted to 
provide a product or at least- a model of a product for practitioners of 
'several "professions, teachers, curriculum developers, curriculum planners,' 
etc. / ■ 

. There h^s certainly been an attempt to base this study on the conclusions 
and writing's of others, '^uch as Piaget,- Inhelder, Shayer, Ingle arid others, 
,Ta this" abstractor's .l^owledge, there have not been siibstantial efforts . to 
develop group measurj^s of developmental stages using manipulative equip- 
ment and materials. Perhaps some of the recent v studies' of Robert Karplusv 
are directly applicable to this needed .'area of investigation. . . 

Essentially, this stt^. showed. .^that the -two^problems dealing. .with chemical 
^change and pendulums, will result in high' school students' responding at 
various levels of sophistication; ^The researchers implied that* tbis is an 
indication* that the two problems identify an/ individual^ s developtiiental 
level. ' The validity of this inference is based on the fact that older 
students provided higher level l^esponses. -Since individually administered 
tasks are widely accepted,' the validity -bf this sttyiy and , the implications 
of this study would be greatly enhanced if there had been attempts made to 
compare the same individual on group, and individual assessments. 

.. '• • . . ^ 

there is difficulty in generalizing the results of this study to a Ikrge' '/ 
population, as the san?)le was selected from ^ne South Australian high 
school and there was not a detailed description of the . sample provided in 
the. report. . F* "example, the subjects i^ere identified as. being "streamed" 
ISy ability, bnt^ there was. not any further explanation in this ;f^ard. 

The rjesearch design used cannot be easily identified with any described 
by Campbell and Stanley. The procedures were really designed to validate. 



proceduTe-and t}ie report is .ia ^descript ion of that effort. ;.The authors, 
Rowell and Hoffman, repOhtt^ed "on. a procedure 'that is somewhat Ireiuoyed froi 
the' classical resea3;c^ designs-. The .report itself could, have provided a 
more systeinatie:: explanation of the steps and clearly have shown where 

inferences •are mde. F5;pin a reader^ s standpoint, .the differentiation '^of 

: ■ . I ■ .\ 

fact' and inferencte is difficult to determine. ; While some conclusions "may 
seem logical, they are in fact generalizations^ that are not evident, at 
least from the information provided by the authors in this report. 

Ii^ a practical sense, the" authors have provided a iray of hope for a 
teacher; who may be faced with the enormous task of' matching cuiraiculum 
'to stages of development. The prospect that an individual's stag^iQf ' 
development possibly may be determined in a group setting is encouraging.. 
This stxxdy has approached tjie problem and could have planted the seed 
for more expansive and generalizable -studies. 
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Expanded abstract and analysis prepared especially for ISE Robert E, , - 
Yag^r, University of Iowa, ; '^^ V ^'Ji* 



Purpose ' - 

The question investigated was whether or not instruction (materials and 
procedures) can be/shown to promote formal reasoning ability in students. 
The central hypothesis • tested was that "concrete curriculum materials'*^ 
and "inquiry-oriented: procedures" would promote gains in levels of inteL-' 
lecttial fiinc^ioning. -iThe study was designed to illustrate |he effect of 
a specific kind, of schooling upon the acquisition ol formal reasoning 
abilities. 



Rationale . 

— - . ^ 

/ ■ ■ 

The study arises, from Piagetian philosophy. In fact^ a quote from Piaget 
/ * is used as support for the theme: 

^ •• .education is not simply a contribution that would be super- 

. . ^ imposed on top of the results of an individual development 

^ regulated in some inborn way, or that is ^accomplished by the ' 
family alone. From birth to the end of adolescence, education 
is one whole, and is one of _two fundamental necessary factors 
^ for intellectual and^ moral formation, so much scT^he school 

dapr^.es a -great responsibility regarding the final success or 
failure of tbe^ individual in pursuit of his own potential and 
adaptation to social living, 

^ I ■ 

The authors review recent "evidence"- that suggests that 40-60 percent of 

'^^^^^ population do not acquire abstract reasoning ability. 

They cite some of, their oxm work at Purdue University which suggests that 

^significant numbers of ^college students can operate only xriJfh concrete 

Vn ideas, ^nd materials^ They suggest that this failure to acquire abstract 
^ - . ' " ' ' '< 

, reasoning ability may ^ result from the use of "inappropriate strategies 

* ' , and materials" .at the senior high and collegiate levels. The authors 

. ■ ' ■< ^«£b. ■ , • 



advance the notion that concrete thinkers can be confronted with concrete 
problem? and that "meaningful inqiifri^s" can facilitate formal reaspning 



abilit;^ in students ' ^ 

•1..'. r- 




Research Design and Procedure ^; ^ 

t : : ■ . ■ ' ■ ■ . ■ ' - I, ■ ■ r • 

Twenty ^students '^ei^e' selected <from 3 students enrolled in i biology 
^'couTi^^for elementary teachers as ttie experimental gro^p. Seventeen other 
students were selected fcrr. t^e control group. ^ Pretests w^re^ administered 
to all students at the end of their ^ freshman year. The tests were Piagetian 
tasks that^ad been used' in 'previous sti/ddes concerning all 300 students 
enrolled. The experimental g'roup was enrolled in "the undergraduate Pre- 
service^Teacher Education Program" while the control group was enrolled in 
ija traditional physics^-course for efementarir scTlool teachers." After ope 
r^ (^two semesters of instruction) posttests consisting of the same battery 
f tasks- were administered' to both groups. ' ' ^ 

After the pretogts were administered, all subjects were categorized into 
substages> of intellecttiai development. The subs tages included: 1)' early 
concrete 'Operational, 2) middle .concrete operational,, 3) late concrete 
operational, '4) post-concrete operational, 5) early formal operational, 
6) middle formal operational, 7) late formal operational. 

The six Piage,tikn tasks used were: 1) conservation of ^^Ight, 2) conserva- 
tion of vol^e using clay, 3) conservation of volume using metal cylinders, 
4) separation of variables, 5) exclusion of irrelevant variables, 6) equil- 
ibrium in the balance. Two "trained examiners" conducted the 30-minute 
intei?views. The pretests were completed in, April of 1973 and the' p(5sttes|:s 
April bf 1974. The interviewers ba^j no^icngwJ^ecfge of whether the subjects 
examined were in tKe Control or experjgiental groups. The scoring procedures 
and testing materials were described in a previous publication. The tasks 
> we|re .given' ^ each subject in the same sequence, • "Level of subject 
responses was evaluated on the basis of the difficulty of the task, the 
*qualit:y of. the student's verbal responses, and his ability to exhibit the 
appropriate behaviors; i.e., to exhibit conservation reasoning, to control 
variables on the esrclusion and separation' of variables tasks, abd to demon-^ 
strate understanding of propo^rtional reasoning on the eqjailibrium task," 



, \ ^ ■ ■ 



Pretest and posttest ^scores' for each^f the 37 subjects (20 in the exper- V 
Imental and'* 17 In the control) were xeco'rdedCand an'alyzed, ' * 



Findings 



[ 



The mean gain in sobstage levejTwas significantly greater for the experi-' 

mental group-. The Man^-Whitnej U Test Was used to test the differences. 

In the case of the pretest mean level there was no significant difference 
. Neither were there "significant differences fox^he posttest mean levels. 
' Hence, the significant mean gain in level fo^^r^e experimental group is 

the major finding of the study. . 

Seven of the 20 subjects in the experimental grouj) gairod two. substages 
and 10 gained one substage. Fouj: of the control group subjects showed a " 
^ ^ pre-: to posttest gain of two, substages while one showed a gain' of one sub- 
stage. Nine subjects (from both .groups) showed no change and three showed 
' a loss of one substage, . " . ^ ^ - . - ^ 

Since the mean^ pretest score- for the "control group was -high, the possibility 
of a ceiling effect was checked by an analysis of covafiance. The F-ratio 
(removijig thfe effects of the pretest) revealed no significant difference at 
►the •OS level. . ' 

The evalua tors were also comparfedT ' There were no fei'gnif leant results ^ 
between evalua tors on pretest scores, > posttest scores, or mean gain scores. 



Tntei^pretation 

The authors feel that the result^ support the concept that the entire notion 
of what constitutes a worthwhile ^education would change if the primary goal 
of educators was to be the production of persons who can think in'the 
abstract. Tli^ey recommend that content be viewed with, respect to two ques- 
tions: 1) Does the content selected accurately portray the discipline? 
Is the content representative of the discipline? 2) Will a particular 
segment of content be useful in assisting, an adolescent or young adult in 
using formal reasoning abilities? There would therefore be a new basis for 



\ 
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selecting content . The authors also^ argue that thei results suggest the 
need for greater involvement of students with the materials of the disci- 
pline. They argue further that the results substantiate Fidget's long- 
standing axiom that "social transmission is an important, and extremely 
necessary component of learning and movement' toward the acquisition of 
formal thpught." ' i ^ 



ABSTRATOR'S ANALYSIS 

It must be kept in mind that this research report has appeared in a publi- 
cation that is not addressed to the researcher. Hence, many of the criti- 
cisms may be explained by noting the intended reader of the article. 
Nonetheless, some of the generalizations and some of " the problems ^^^J^ the 
design- should be considered. Erroneous cctoclusipns can often result from 
over generalizations and unanswered questions concerning design. Perhaps 
there would be fewer generalizations and more information available in a 
research report prepared primarily for active researchers. However, one 
has only the brief manuscript or purposes of critical analysis. 

*v-^ ■ 

-Researcljers need to exercise more care in categorizing students (and people 
in general) as to their level of intellectual development. Certainly there 
is some arbitrary definition with respect to the seven substages described. 
However, one needs to realiz^ that the categorization may refer to one or 
more tasks. Much valuable information may be lost when the researcher uses 
a total score from a variety of tasks. Further, some erroneous conclusions 
may result. The researchers could (and perhaps should) report the effects 
of tHe experimental design ugon each task rather than blend tTfe results 
together for a single total score. The r^esearchers ' are to be commended for 
the use of the individual interview and for the careful comparison of 
evaluator performance. * - ' 

Relating the study to curricula, teacher educators, and the growing infor- 
mation from Plagetian studies is a commendable feature. Certainly the 
attention given 'to such research in both curriculum design and teaching" 
methodology suggests the importance of the study. Its appearance in a journal 
for the npn-researcher suggests its interest and Importance as well. 



In view of the major problem with duplicating, such experiments " at other, 
centers, more information concerning the- exact protocols would be helpful* 
. The re:eearcher^ carr be excused for their omission in- view of the publica- 
tion and the audience. liqwever; much more precision in t^rms of describing 
specific experimental profcedures is necessary before the experiment -could 
be repeated independentlpr.^ The researchers, also assume that the tasks do 
measure the behaviors and/or the levels as described by Piaget, The 
literature contini^es to suggest research problems and unans^/ered questions 
In, these, areas, ^ - ' 

Some guestlons concerning, the use of parametric statistics instead of non- 
I>arametrlds can be raised. Again, the careful researclier is anxious to be 
free of possible criticism concerning tfe choice of statistics and/or, being 
able to meet all conditions for proceSures chosen, 

Fiiially, the researchers use many -terms and^ phrases as if they -have univer-- 
sally accepted def initiotis. Perhaps more precision in writing is even more 
Important for the practitioner than for the researcher. At least the 
researc^r is likely to request more adequate information before accepting 
results and interpretation than is the practitioner, ^ome examples of this 



^oncern*are: What is an "inquiry ajjproach?" How d6es one recognize "con^ 
.Crete curriculum materials?-" What characterizes a"" "laboratory?" " Are all 
so-called laboratories places where inquiry occurs? - What is "teaching 
through inquiry?" What characterizes an "integrated science experience?" 
What> makes an examiner "trained?" ' * 

Some question's are raised by reference "to "instructors "providing" exper- 
iences and students "taking" courses. There seems to be some internal 
inconsistency concerning philosophy of the researchei;s, (or instructors) 

♦ 

and the descriptions used — at least those other than thfe ^special terms 
that are not adequately defined. 



The researchers fail to establisl^ that the experimental and control groups 
are identical. Wer<^^all 300 students in the freshman group? How did spme 
get into Biology 205? Were some taken out of the class, and enrolled in 
physics? How does enrollment in "the undergraduate Preservice Teacher Edu- 
cation Program (the experimental group) differ from enrollment in a 




trd4itietlal, physics course for elemefitary school teachers? Were ,the^ 
staaents in the experimental group selected for that course randomly? 
Were the 17 in ^he control grout? alj^o selected randomly? More descrip-^ 
tioti of the cpurses and the strategies would be desirable. Was the ^ 
' physics group (control) self -selected? 

The article is basically a very good report. It is clearly written and 
one that is a contribution to the field. It represents well ,the state of 
researcti in the area of Piagetian-type studies. There are unanswered ques- 
tions, some pr<fblems of design and interpretation, some disagreement • • But 
that is why it is so important and so valuable as an area of study, 

* 

Reports such as this one are badly needed^ Too often Piagetian studies 
merely verify what has been done or report differences from study to study 
or culture to culture. This arti«ie is a f ine' attr^pt to use the* informa- 
tion to affect programs. Much moreT research and effort is now needed ^^to 
bring exciting research information to the position of making a difference* 
in education. The authors end with a timely charge:' t:he time has come 
for college and university to examine critically what they are teaching 
in individual courses, .why it is taught, and how it is Being taught. This 
reviewer applauds the charge and this research effort I 
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Linn, M. C-, and' H. C. T^le'r. "The Effect of Experiential Science on 
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Expanded Abstract and Analysis Prepared Especially for I.S.E. by Michael 
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( 



Purpose , . ^ . 

Linn and ThierKl975) conducted an ex post facto study (Kerlinger, 1964) 

-*e-^assess the effect of .selected unit^ from SC IS on the development of 
logical thinking in fifth grade children. . .. ' 



Research Design and Procedure ' - 

The design chosen, was basically a nonrandomized post test-only control 
group design. The major independent variable tos the study of at lea« 
the Energy Soj^rces kjnit from the.SCIS program. The criterion variable 
was mean score on^s' ability to .explain in writing selected phenomena 
(inclined planes) dealing with >cx5inpensating variables that were presented 
to the students during the experiment. 




The S^s were enrolled in intact classrooms of fifth and eighth grade 
students; the fifth grade students either, had or had: not completed^ Energy^ 
Sources, but the eighth gradefs had not. In the experimental task-Ss 
were shown film clips of the motion of a cart on an inclined plane under ' 
different (compensating) conditions of starting height and surface fric- 
tion. The main- criterion variable was assessed throu^ written free • 
response to a question designed to elicit an explanation of the phenomeipn 
which was{ observed. ^' j 

. • ■ - . • - ■ / ' • 



Findirfgs 



It was cpncluded that SplS students understand compensating variables 
.better than did non-SCIS- students in urban fringe, suburban*/ and rural*' 
areas of the country. . ^ ' 

In t e rpre t a t ion s 

. • .■ . ' • ^ . ■ ■ / ■ ' ^ 

The study also reviewed logical thatight according to Plaget and. the 
rationatle for the use^of ^CIS in develop4.ng and studying formal thought* 
More specifically, it was argued that understanding dtompensations- involv- 
ing two known variables is an. indic;^tion. that the student has -reached the 
end. of. th^ concrete stage and ready to begin the formal stage of developT 
• ment • • . . 

. ' t- * 

- . - ■ ■ ^ ■ . ■ '.J ■ ■ . * ^ 



ABSTRACTOR'S ANALYSIS 



Althou^ the authors used the words e^^eriment and experimefeter, the ^ ; 
^reviewer must classify this sttidy as ep; post faaio^ or correlational in 
'nature^ The latter form of research |4s by ito jneans' toimpbrtaht f or the 
btijk of much useful 'research (e.g. , research linking smoking and forms 
of cancer in human .beings) is by and large correlational . Correlational^ 
research, however, does aSlow for certain errors of interpretation and, 

this reviewer will attempt tovidentify soiae of those potential exv^s. 

. . tJ , ■ ' , • ■ 

The^researchers should be commended for their study relatin-g theory and 
curriculum development using large samples from varying types of* school 
districts (suburban, urban fringe, and rural) and maify states. * The 
study provides a good example of a nationwide data collection and analy- 
sis effort conducted at a distance and in an tmobtrusive manner. However, 
some alternative plausible hypotheses^ (threats to inte^tial validity of 

ie design) are present in the study; it is hoped that their examination 
Vill serve to further the cause of .experimental research on effects of 
science instruction. » - : ^ 
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The key problem is that, as much as^we would like to, we are unable to 
draw the causal inference from this study that selected SCIS experiences 
cause understanding of compensating variables or 'logical thinking in the 
population. Self- and other «selection processes, potentially present in 
. ex^^ost faet^ research, strongly suggest the .phenoiaenon that^ ^enever - 
innovations such as natipn^l science curricula are adopted; better • 
teacheris are' selected C^nd trained) , better students swre chosen, ,and • - 
extensive materials are purchased. One ipi^t infer that most curricula . 
would "succeed" mdsr such conditions. For eat^mple, implementation of 
SCIS programs is us.ually accon^^J.ed by some vendor training/or in some * 
other cases, training by science educators. The link between inservice 
training and degred^ of implement^tioil has been firmly established in the 
'literature (e. g. / Ashley and Butts, 1971; Crowther,\ 1972) 'Self- , 
•selection and concomitant associates such as inservice training are seen 
as one source of differejitial, selection bias in this study. \Anothe^ 
sourte is the selection -of subjects, who were presumably- identified by 
school personnel. , A significant alternative plausible hypothesis is 

that improved performance in the sample is an artifact of differences 

J . . " . . 

between the tpreatment groups which are . imrelati^d to the treatment. ^ 

It can be argued that students with more articulate x7rit,ten;'Sfcills will 
. outperform students with less articulate skills on .a written explanation. 
Indeed, general ability is posed by the researchers to explain observed 
sex differences (p.y59). One might similarly attribute higher mean 
scores bf the SCIS Sift6 graciers to superior general ability of "better" 
students selected for sCi^. No indication is given that general ability 
was ineasured or controlled to te^ this alternative hypothesis. To the 
extent that the above argument is valid the, causal nature 6 f SCIS on the 
criterion is severely questioned. It also calls in to question the 
researchers' assertion " — it follow^^hat experimental teachers were 
generally effective in teaching. . .'f(p/ 59) . ^ . ^ \ 

A further problem common to curriculum studies deals\with implementation. 
Wlile^manj^^ studies rely^on reported use as the measure of implementation 
(Persall, 1972), sucli reports may reflect only an attitude of acceptance 
rather than the possession of necessary knowledge and skills. Fullan 
an^Pomfret (1977) reviewed studies that suggest a positive relation 



between" degree of implementation and achievement scores. They observe 
that without teacKer irapleroentation behavior changes, student process- 
outcomes will probably not 'occur. The degree of implementation of 
Energy Sources in this stu^ seems to be an' unknown quantity. 

^- ' 

The reviewer is open to- an apparently valid criticism for using subse- 
^quent research in analyzing the earlier work of Linn and Thier. The 
only defense pleaded 'is that the reviewer^ s goal is to improve research 
skills which enable us to acquire valid knowledge; it is not to criti- 
cize . 



Recommendations ^ ^ . j . .\ ' 

• - / "■ 

. In light of the^above arguments, it would seem' that a series ofi^e^peri- 
mental studies with certain characteristics* would better test the causal 
relation between curricula *kxj. .formal thinking. -First, the, rationale 
between process or formal thought Skills targeted in the curricula and • 
those reflective of the acquisition, of formal thought sJibiRd be clearly 
established. Next, a design should be constructed* in which students and 
teachers are randomly assigned to treatment or control, with variations 
in general ability and sex, care'f tilly controlled; 

Perhaps the better tesl^ of the criterion is-one which takes place in a 
•*white noise" .environment where many (or 'some) other variables are in 
operation, rather than in a controlled environment where two variables 
are purposely higi^lighted xAile others are systematically eliminated. 

The research <e.g. SmedsluQjd, 1961; Flavell, 1963) strongly suggests that 
training is hi^ly unlikely: to accelerate. Piagetian stages^W development 
unless the student is transitional aiid in a state of disequilibrium. 'From 
.this,«one might; hypothesize that developmerltal gains will occur* from 
instruct idfrrfcn- terms of the percentages of students who are transitional 
prior to instruction. i ^ ' . ^ ^ 

Ifole'ss .such exper^falental research is conducted, we; will have to wait for 
massive amounts of Vorrelational data for a true picture^o^ the relation 



between- curricular practices and progre.ssjLoa thjrou^ developmental 
stages. - . -i 
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Purpose 

Quinn and' George evaltiated the eff ectiveness^^of teaching hypothesis forma- 
tion to grade school " children. Thipy were interested in the usefulness of 
the method ^mployed, ,the measurability of hypothesis /quality, and if qual- 
ity 'differences were discemiblei among, groups isolated for analysis. ^ 

■ ' ■ "j • ' ' ■ ■ . ■ ■■■ 

Rationale 

The Investigation is considered an extension wprk by Atkin (1958), and - 
is likewise done in a classroom setting. ^ - ' 



Research Design and Procedure 

Quinn and George developed an Hypothesis Quality Scale (HQS) from which to : 
judge student hypotheses. The meaning of "precise" was also clarified 
through a set of statements called "Princij^leV of Precisioti" (PP) ; t'he PP 
• / was used to support the HQS^ Reliability of the HQS was verified by hav- 
ing tl^ee science, educators judge 50 hypotheses (0.94 agredbent) ♦ 

, ' The study has a treatment-nontreatment format. A total of 176 sixth grade 
st^udents from four- intact classrooms, two from each of two Catholic schools 
of differing socioeconomdc levels, were subjects.. One class from each 

^ school was in each of the treatment ^and nontreatment groups, for a total 

of 88 subjects in each. v ^ 

. ■ ■ ■■ * ' - ' ' ' 7 / • ' ' ■' . ■ 

All stibj acts completed the Otis Test of Mental Mai^xnrity prior to treatment. 
Jhe results served as a covariable' in an analysis. of covariance that ^s 

'ERIC : >., 27; : . • ' ■ - ■ - ■ 



part of the Campball^it^ Stanley Design Twelve procedure.^ All subjects 
wrdte hypotheses on' test films before and after instruction was given to 
the. treatment group. Mean scores- for hypotheses ^oduced (scored against 
the HQS) were subjected to. analysis for significance. 

Treatment consisted of a series >of eighteen '40-minute sessions: film loop 
showinrg (two sessions) follWed by discussion Cone session) in rotation. 
The loops were pr^^uced by the Iirquiry Development Program in Physical ' 
Science. Each showing was followed 'by discussion, questioning, reshowing/* 
and hypothesis vnriting*:^ Hyij^theses'were scored for subjects according to 
the HQS, ^e separate discussion" sessions were aimed atf improving hjrpo- 
thesis, formation. . ^ .. 

■ ■ ; ■ \- ■ ' . -. '^ ■ ■ . ■ 

Before , treatment subjects had been divided into' groups: 

■ . ■ ■ . . .tf ' .■ . ■ . • - 

TREATMENT ' NONTREATMENT 



^ (1) Socio I (2) Socio II (3) Socio I (4) Socio II' 

1 ■ "J • • 

Subj^ts in each of groups one to four were further divided for analysis: 

a. high and i^intellijgence, . 
,!>• high and, low/ grade point average, 
"^ " ;:c.; • high and^'loV readli^ .j . ; * . ' \ . • / 



r. sex. 



Thus, eight cells «fere. available for eachVof I four, analyses of covariance. 

Interactions of treatment, socioejconomic level and. each of the variables 

> • ' ■ . • . V ' ' * • ^ 

above were considered. v 



A ■ . . . ; 

Findings ' • , . ^ ' ^ ^ . 

Quiim and George made the folloxjing. findings: 

1. treatment was effective at the .001 level of significance; 

2. no significance was attached to socioeconomic status; for the 
sul^groups significant differences were found in the ability to 
form hypotheses; \ \ 

. • . 3. between levels of injbjelligence (.02 level); V H 

^ ^ /; 4. based on grade point average levels (.001 level); 

'ERIC 



^•5, between groups by reading ability* (.01) ; and/ 
6. based on sex (.02). , • 



In t erpr et at ions 

vestigators concluded from their findings that hypothesis formation 
uian y(^^Jt^^t ^under the condition's in thi study; * that the method used can 
sful,. includ'ii^g the use pf the particular film loops x^i-CTPiSLxth 
children; that quality of hypotheses can be measured using the HQS; 
tfeat equal instruction allows- children of- differing socioeconomic levels 
to successftilly learn hypothesizing; and > that the ability to hypothesize 
is correlated with intelligence, grade point average, reading ability and 
sex of children. 




ABSTRACTOR'S ANALYSIS 



The study is a straight-forward investigation that fits within the well- ' 
uised philosophical^ statement by Bruner about teaching people when they 

^jiare * ready to; lear^ But there is. no^^ either in the procedure 

used or in the outcome. Rather, Quion and George carried out a reasonable 
teaching assigtiment and obtained resiilts they expected'.- What we do not 
know is whether or not students reached a level of mastery and so have 
retained tjie skill j or if the students could generalize to tdpics other 
than science. Perhaps, however, such thoughts elevate the importance of 

-the study fa^ beyond that intended Ky the investigators. ' 

There ha\^ been many investigations in tlie literature of science education 
abotit teaching proicedures. Indeed- it is possible to find support for 
almost aioiy reasonable position ia, reviewer may wish to take^ However, 
blinders are necessary if one wishes to claim support for one position 
only. Quinn and George do not make such a claim; rather^*, they state 

sijiq>ly that the study -supports the claim that the method works ^ 

# • - 

Many studies that are reported in science education journals have nagging 
minor deficienOMfeaT, either as a, result of reporting weaknesses or of 




features of the studies th^selves. The study here under review is no 
exception. Following are some concerns. 
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It would be helpful to know the circumstances under' which the three science 
educatoifs undertood their valUdation^^of the HQS and who the persons were. 
Often the captive talents of graduate students are pressed «> service and" 
instructions are so carefully given that expected- resul<:s are .obtained. 
The report level of interjudge- agreement suggests no difficulty in this case. 

Use of intact classes for research, purposes, while a cont^eiiience,, leaves* 
questions unanswered. How" were 'these particular classes in these particu- 
• lar schools chosen and why? Would different results be obtained from 
different classes? The study may not have been affected- by the use of 
other classes, but/we are not able ,to judge the range o ^intelligence, read- 
ing ability and achievement and achievement in the sample. Even so, a • 
reviewer would be on the v^ong track to overdo- criticism of the points in* 
this study, for the out^me is^ nelsonable a:nd expected. 

That the film loops were useful and ai^ed in .the, instrbction was shown by 
the-fetudy. Availability bf the loops to most sixth grade teachers seems 
unlikely. In that event, the teacher would be left with- the discussion - 
. sessions ;and^pos^t|t^ than that available to ' " * ; 

/£hS^ investigators. The reviewer must: w6nde"f how inucli -farther^we .ai:^ ^head"-l^i^' 
in a practical sense as a result of the ^udy. " " \ - 

The levels of intelligence, grad^ point av^age, reading abilCity .and sex 
receive no comment other than in the summary of findings. «^Is it not likely 
that the differences in hypothesis formation would be found? It seems- evi- 

. dent that intelligence, grade :point average and reading ability are inte*.- 

^ related and may be measures of similar, if i^ot the same, va^iablSbS. On the- ": - = ^ • 

'other hand, the .difference lii sex of subjects opens a question df maturity, 
that could be naturally reflected in the results regardless of treatment. 
It would be interesting to haye the^- question of differences in mental^ 
manipulation by students explored on this point alone.. 

Qulnn and Ceorge reported here that.tequal in^ruction was given to each . 
socioeconomic group. This is a difficult point tjc^ prove. IThich group " : ' 

. first received instruction? Did that group have aji^^ or 




disadvantage dom^P^^^^t^he. <>ther? Doe^/a .cl^ss of 50 students benefit 
more. or. less , from ^".equai" instruct icm compared to a class of 38 students? 
At best., we may. 'Conclude that the two rankings by socioeconomic status were 
Instructed so that no significant^iff erence was found in hypothesis form- 
, at'dtfli, . ' ' • 

.7:.-: ■ ■ ■ ■ . 

The^ sample for this study was 'ijot )a large*^. one, given the subgroups required 
for' analysis . Should one try to draw conclusions from cells of fewer than 
20 subjects? Ma^y reported studies share the disadvantage of small samples 
or .parts, thereof subjected to high level analysis, Quinn and George seem 
in the same position here. - 

■ - k ■ . ^ 

Even though the deficiencies exist, it may be concluded that the results 

are reasonable the procedure fair, Ilie outcome is not likfely to affect 

science education to any extent "^ut may *assist other investigators who 

propose to explore.inj|tructVonal procedures in classroom settings.) ' " 
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Butzow, John W. and Alan Davis • "The Development of a Semantic^Jiirffwren-. 
tial of Teachers* Attitudes Toward Teaching Elementary. SdJiool Science. 
Science Education , 59(2) :211-220, 1975. 

IJescriptors — Elementary Education; *Elementary School Science; 

Educational Research; Inservice Teacher Education; ^Measurement 

Instruments; Science Education; -^Teacher Attitudes; Teacher 

Behavior. 

Expanded abstract and analysis prepared especially for I.S.E, by Ann C. 
Howe, Syracuse University. 



Purpose ' /. ^ r 

The purpose of this study was to develop and test an Instrument for pre- 
dicting teachers! relative -levels of success in using a student-centered, 

Opposed to a teacher-centered, elementary science curriculum. A 
semanti(r/fl1J5fea;;ential was developed and used to assess teacherg' attitudes 
toward teabhing\he Elementary Science Study (ESS) program. / 



I 



Rationale / 

■ ' ./ ^ ■ ; " ■ 

This work restq on the asstmq>tion that a teacher* s level of success in 
^usinIS;a particular set of curriculum materials may be predicted b^ deter- 
mlningWhether the teacher has'^sitive -^attitudes toward the b'ehaviors' 
which the developers of the 'curriculum consider desirable or nece^ary. 
IxL this case the indicator for level of success was the degree of I 



"student-centeredness" achieved by a teacher. 




The reasons for ^choosing the semantic dif fer;ential^We not explicitly 
stated but there is^ample preceden^ for* using this technique to measure 
attitude. A number of previous studies are cited. 




■ J * 

Research Design ana Procedure . 

A semantic differential consists of a -set of concepts, ^each followed'by 
thie same set of polar adjective pairs arranged at opposite ends of a scale. 
The concepts may be thought of. as stimuli to which the subjects respond by 



rating each concept on each scale. I^th^s study three initial concepts 
related to teaching were rated on 46 adjective pairs by 104 college students 
enrolled in an elementary me'thods course. Prom factor analysis of these 
data four major factors (valuing, enjoying, striving, and difficulty), 
emerged* Adjective pairs representing these, factors were used as scales . 
.^for the final instrument. , The initial conc^ts were discarded and a new 
• set of concepts chosen by searching the writings of persons who had been 
active In the development af ESS. The final instrument, c^led Semantic 
Differential Test 'pf Teacher Attitudes (SDTTA) , con^^ined 21 concepts and 
four scales. * ^ 

The ability of the instriiment to predict behavior was tested by administering 
it to 29 elementary teachers who had recently completed an inservice course , 
and were readv to begin implementing ^S. Several months later, after imple- / 
mentation was/underway,, the teachers were videot^psdwhile^teachirig science 
in their classrooms. The videotapes were analyzed using the Science Curric- /[^ 
^ ulum Assessment System TeacKer XMatthews and Philips,. 1968)" an instrument 
which yields scores on a Teacher Directed Index. A low score on this index 
indicates behaviors congruent with^e expectations"^ the developers -of ESS. 
In ordel to determine whether the' attitudes, as measured by the SdTTA, were ' 
corr^ated wifh the observed behaviors, as measured by the Teacher Directed 
Jndex, vthe scores on the two instruments were compared. . The set of scores ^ * 
above the median on the Teacher Directed Index were labeled Teacher Direct^ci 
,Grtfup an^ scores below the median were 'labeled Student Directed Group. 
Scores for the first three scales (omitting the adjective pairs representing 
"difficulty") for each concept of the SDTIA were also split at the median. 
Frequencies of scores thug obtained were, presumably, entered into a 2 x 2 
contingency table ^ from which Chi square values were calculated.' Six con- 
yielded a chi square value significant at the 0.1 level. 



Finally, -the concepts of the SDTTA which were found to give a significant 
Chi square ^alue (above) were used to calculate a D-square value for each 
participant, .p-square represents a "measure of dissimilarity of ^partici- 
pant f rom ,the average, scale scores, on the Student Directed Grcfcup." 
Participants were r^ ordered on the basis of D-square values and on the 
basis of Teacher Directed Index scores. A Spearman Rank Correlat;ion co- 
(efficient of 0.79 was obtained from these data. " ^ . . 



ERIC 



36 ' 1^ 

• 38 ' ^ 



\ 
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Findings . . , ^ • 

It is somewhat disconcerting to.fijid that the data of greatest interest 
are not reported. One looks in vain for average scores- on the SDTTA 
item? "of the two' subgr:oups, the data used to ^calculate cKi square, or 
the chl square value obtained. 

The principal findings were the following: . / . 

1. Of the 21 concepts^ on ^he SDTTA there were six which discriminatejd, 
at tMe 0.1 level and on ft least one scale, between teachers whose 
behaviors were judged to be' student directed and those whose behaviors 
were judged to be .teacher directed. The six. (incepts and the scales 
were: ' ' 

A. For me , allowing children to mess around with water is... 

. ' " * ~ *' ^ 

(Powerful/Powerless) v ^ . 

" ' - ■ . ■ ■ ^ - - . * / * ^ ' T . . 

r . * B. For keeping live ^ants and animals in the classroom: ^or use 

in experiments is... (Important/Unimportant; Powerful/Powerl6ss) ^ 

C. For me , being able to correctly answer student questions in science 
V is..: (Enjoyabl^Unenjoyable) 

D. For me, allowing children to work in groups to discuss their ^ y ' 1^ 
*" different points of View fSSft findings is. . .(Enjoyable /Unenjoyable) 

F. For r^, teaching ^science is.1. (Enjoyable/Unenjoyable)^ » 

F. For me^ having a strong- background in conceptual and factual 
science is... (Enjoyable/Unenjoyable) 

On the first concept the Student Directed Group gave a leiss positive 
fating than the Teacher Directed Group on potency; that is, the 
Student Directed Group rated tthe concept as less power ftOT. On the 
other five concepts the Student Directed Group gave more positive 
ratings. 

■ 2. The. correlation between scores on these six concepts (above)* and 

scores on the Teacher Directed Index, using the Spearman Rank Corxte- 
lation method, was statistically significant at the .01 level, .' 
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Interpret at loRS . . ^ 

. ' \ : • • ■ 

The Investigators interpr/^t these results ^as showing that they have ' 
developed an instrument vrfiich may be used to predict the degree of teacher 
directed activity or, conyersely, the degree of ^tudent-centeredness in a 
given teacher's classroom, *^ 



•ABSTRACTOR'S ANALYSIS 



The semantic differential technique was developed by Osgood, Suci and 
Tannenbaum (1957) as a method of measuring the meaning* which people attach 
to concepts. Every » conqept is thought of as having a semantic space which 
may be explored by- means of thls^ technique. One of tha dimensions o£ this 
•semantic space is attitude,V defined as an inferred state of an brganista 
which gives it a predisposition to make an evaluative rest)ons0 to a given 
stimulus. Attitudes have direction/and 'intensity; they are sometimes' 
referred to as tendencies of approach or avoidance. Most social scientists 

^ agree that the T&ay a person behaves in, a sit^a£^pn depends upon what the 
sitiiation mean.s or. signifies to him or her and that attiiu^ is ^ impor- 
tant factor in any . social activity, of which teaching may be taken as an 

',e5caii5)le. In t^fe^jsjo^ thrf semantic differential, attitude toward a concept 
is defined: as the projection of the' meaning- ascribed to a concept onto the 
evaluative dimension of the. space • ' ' , 

Another way to s^y this is that a person's behavior depends to a great 
extent on h*is or her attitude; if we could^measure attitude .then we could, 
to ^ome extent, predict behaviot.; This is what the investigators have 
tried to do; they have sought 'to find a way to measure attitiid^ in order* 
to .predict behavior. ^ For this purp9se they constructed and tested a 
semantic differential. * ' ' . 

Seen ^ in final form, a semantic differential is a^4eceptiveiy simple iastru- 
meht which belies the care xtth \rfiich the. ccJncepts and scales must be 
chosen anS" tested. The procedure described by Osgood ^et al . starts with ) 
the selection of preliminary concepts and polar adjective pairs. The 
latter are adjectives which have& opposite meanings; for, example, good/bad"; 
hot/cold^ deaa/dirty. The conqe^ts and adjective pairs are submitted to • 

. '31; , ■ ' : 



■ ' - \ • •• • / . ■ . ^ - ' 

an appropriate gtoup who rate each, concept on each adjective pair, using - 
a., scale whiql^^^stoinarily goes from 1 to 7/ The adjective pairs are then 
submitted to factor. ana;Lysis and, if they, have been well chosen, three : 
dominant factors become apparent, lii paost cases these cag^ be defined as 
. evait^ation; potency,/^and^ activity. |wo or three adjective pairs are then 
• chosen tb represent each factor ^nd these form the scales of the final 
. instrument . The preliminary co^^pts are then replaced by a new set of 
' .concepts to be rated on the fin^ set of scales. When the semantic 

differential is to be used to measure attitudes, only the evaluation factor 
is represented by the adjective pairs since^ttitude- is thought to be most 
closely related to this factor. ' ' 

^The developers of the instrtmient ^presented in this article followed these 

\ procedures in many respects but departed from them in other ways^ for 
reasons which are not explaine^. We are not told, -for eixample, why all 
four factor? were reta^ed in selecting represent'ktdve -scales, rather than 

^ only the evaluation factor which As the one associated xd.th attitude/. And 
if all four factors were to be ' retained, it would have' been the usual 
practice to selett two or three adjective pairs . to represent each factor 
rather than only one for each, factor-. A minor point which is puzzling 

. nevertheless is why five rather than seven points were used on the scales. 
The authors; could probably supply reasonable explanations for each of 

' these |epart^es from the original. method; often trivial and not-so-;>trivial 
questions are^ lef t unanswered due to space limitations or other good reasons. 
A description of the development of a test is more useful to others, however, 
if such departures from accepted procedure are noted and explained. 
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More; important than any of the above considerations is the question of 
whether the SDTTA serves the purpose for which it was totended. At this 
point a digression seems in order to commend the authors for^ carrying the 
development of the instrument beyond ^the initial stage. Too 'often we are 
offered "instruments" which have been designed with some care but are pre- 
sented prematurely and left for others to validate (or ignore). 

§everal serious . questions must be raised about the usefulness-of /Che SDTTA 
,Jn dts p'resent form, ^e first of these concerns the small number of items 
for which a conflation could be shown, even at the marginal <0,1) Jevelof 
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Significance, between *the predicted behavior and the observed behaivior* ^ . 
Since 21 concepts and three scales' were used in the analysis, the total 
number of it€ims, as -items are deferred in Osgood et aX > (1957; p. 80) is 
63. .Seven of these were- found to be significantly correlafed' with 
observed behavior but one of these was in the direction opposite to that 
predicted. That leaves six ^t ems, of tlfe 63, which could be used to 
'' ^^^ j^- predict behavior. . y - . - . ^ . > 

- Another question might be asked about the r^iability of the scores. 

Do we know, that a teacher would give the same ratings to the concepts on 
^ a second administration? , Or, to put it another way, is th^e evidence 

that the' attitudes are stable over time? 

A third question concerns the meaning and Use of the D-square values. 
This is a aiurky area which carefiil reading of 'the text and reference to 
Osgood et al . have failed to clarify. It is not clear to the reader wj^o ^ 
is tiot an expert how the D- square values were . obtained and what-, they mean. 
Were all six concepts,^ including the one which showed an attitude in the 
"wrong" direction, used in the calculation?^ Were dissimilarities from ' 
the average score measured without regalR^- to direction? Without more \; 
- expfanation it is diff;LGUlt to evalxiate the significance of the cbxxela- 
. tion coef*ticient . This may be a quefitibc: for which tl>e. autihors have a ' 

^ -.ready and convincing answer I>ut Tiv^n]^ readers ^)^^ nieed more details or : 

a reference in pr^er to understand the basis and use of this pirocedure. 

y . . ' r .. ... ■ ■ . . : 

r "... . ■ ■ ^ . • ■ ' ■ • ■ 

As it 3tapds, the ^TTA does not seem to be quite ready for use in making 
serious predictions of a teacher's level of success in implementing an / 
activity-centered elementary science curriculum since only about one-tenth 
of the items have been shown* to be useful. in predicting teacher behaviors. 
This ..is a promising beginning for an instrument which might find many uses 
in* both preservice and i^service teacher education, ,^ut: more needs to be 
done to m^ke it a reliable and. usable. £ooi for research and tradtiing^ 
". ^ . ." 
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Purpose ■ : " ■ " * . - ".\ ■ ' . ■ '-' A'. - 

The major purposes of 'these two articles were; to:/ v : [' 

Repozn.on the tfeveloftoent In four la]&guages (Engl^i^ ' 
Hiri-Motu and Ehga) of an. attitude scale named "The Environ- 
/ -mental Phenomena At tit ijde Scale." 

2. DetermjQie if scores on the scale can be attributed to the educa- 
■ ' " ' • "* , ' . ■ 

/ tiohal level, region of prigin, life style (urban or rural)* or 

«ex of the study sanqjle/ * • " 

3. Determine if there is a significant difference between the mean 

• scores obtained by students on the Environmental Phenomena At ti- . 
tude Scale, and the mean 'of the score predicted by the student 
for tmeduca ted people, " V* ^ 

4. Determine if there is a significant difference between the me\n 
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scores predicted by the students for minimally educated subjects 
and the mean scores actually obtained by them* --^ 



Rational^ . . ^ " .. ' . ' ' ' • • / ■ - v ' V 

.Developing countries often; fade /t^e" fact that fQ schooling chants 
the. attitude of sCadents Extensively, and that these changes have tlie 



potential, for cheating a major gap between.*tlife educared and 'meducated 
which can lea<i to alienation and/or confrontation. The purpos^of this 
sttidy was to determine if significant attitude differences existed 
between high school fitudents and villagers with respect, to beliefs about 
man's ability to investigate, manipiilate, and control natural ph^oinena* 
^Furthermore, because the author wished to etxplore . attitudes; , of a broad 
. spectrum of Papua New 'Guineans, versions of the instrument were developed 
in English, Pidgin, Hiri-Motu and Eng'a (Raiapo dialect) languages. It 

was assumed that data obtained from these studies would be useful for 

/ ' ■ ' 

feBucafeional planners because the documentation of extensive attitude 

■ . ■ '. . * ^ > 

differences could suggest a heed for extensive adult education 

Research Desigtk^^d Pracedure . - - ^ '"^ ■ ' * ' ^- > > 

The study ; involved ins Jirament developi?ent > val&at ion , and' hjrfwtthes is 

testing. • " .'\ ' .'^ ■ ■ ■ ■: v : . 

The ••Environmental Phenoigena Attitude Scale" J was developed ^ in Papua Ne<7 
Guinea, t>y means of a nxiinber' of field trials. The ■ instrxament*^ consists 
of 26 items stroactured as an interview schedlile. The items constructed 
• wetre based on fiv^ attitude related objectives stated as alms of the 
Papua New Gtiinea, science syllabus. These five objectives were related 
to investigation of nattural phenomena by observation or experiment , the' 
us^..-ef "exp^ixE^tal results add observations , technologies as man-made 
<ievelopments,\ the need to test cultural .models ^r theories and the need 
to change models and theories in light of new^ discoveries. A person who • 
believed or had\faith in the susceptibility of the universe to htmian 
ordering and linde^^^tanding wa^s described as having a positive attitude 
towards investigation^ manipulation, and control^ of natural phenomena <. 
The establishment o f reliability of the instrument , in ter-ob server rel ia- 
bility of interviews, and validity of the instrument were described in 
previous efforts by Haddock (1973, 1974). An instrument development 
section is included here to describe additional evidence supporting the 
argument for Che instrument's constru^^vaiidity. Construct validity is 
supported vhen one can correctly predict test scores from" theory or theory 



like statements.' In this case antljropologists' conclusions were that 
the attitude scores of villagers Ton instruments such as the Environ- 
mental Phenom^a Attitade Scale)- who were not formally educated in 
school should be significantly loweaj th^ the attitude scores of formally 
educated high school students. - 

A hi^ly significant mean score difference (13.6 points) in favor of the 
educated student provided support for^he construct validity, argument. 

■•• ^ ' ■ . • _ ■ , ^ • ... . ■ . J" . . 

SypptJ^sis Testing ' ' ' 

• . , ; ' ■ * ■ * ' y 1 ' • . .- ; 

The investigator reported using 2X2X2 analysis of variance design to tes^ 
the effects of education : (high school^stude^ vs. villagers) , region 
(coastal vs. highland) j .ajid M rural)'T^ The only signi- 

ficant mean score differehces: (13^6 points) ^reported.were between levels 
of education and 'the difference favoring the' educated -ras"^ significant 
beyond the 0. -001 level with an epsilon (E) of 0.78. , * 

Analysis of variance was used to explore differences between males and' 
f em ales but no significant differences were reported-.. The author also 
reported that no significant; differences Vere foiind between the two major 
ethnic groups in. the sanple, the Enga^and Chimbu. ^ 

In open-ended discussions following the formal questioning, th'e . students-^ 
made frequent reference to the importance of science in developing the 
attitudes* they held. The students w^re also asked to predict which 

"answers they thought the uneducated villagers wotald give and the feasors 

* • ' ■ ' . '^^ . 

for thqj[.r predictions. • 

• V ^ , - ■ ; • ' . ^ ■• , ■ ^ - ' . • : - 

Haddock employed a t-test to determine if the differefnce between the mean 
of scores obtained by the students on the attitude scale and the mean of 
scores predicted by students for the minimally educated, was significant. 
A highly significant (p <.001) 21.6 point difference favoring the formally 
educated iifes found. The Pearson product moment correlation between the 
students' scores and the predicted scores was calculated to explore the 
relationship between the students* scores and the scores predicted by the 
students for the minimally educated. A significant negative correlation 



(r = -0.26) was discovered vfiich led -the investigator to conclude that a 

tendency existed for students scoring high on the scale to predict scores 

lower on the. range than predictions made by students scoring lower, 

.... . , • , . . ' . f. ..-^ 

Haddock suggested that this indicated that the •more positive the student's 

score the mora likely He/she xoas to stereotypy his village "wantoks" as' 

negative in attitude. * ' 

A t-test was also used to determine ifl the predicted score means for the 
minimally educated: and the mean of scores actually obtained by them * 
differed .significantly. The difference was found to be highly significant 
(p<.001), indicating that the' students predicted significantly lower scores 
for the villagers., ' - 

In open-ended questioning of students that followed the formal interview ^ 
information was yollected that allowed the investigatoi;^ to make the 
following conclusions: ^ 

■'• ]>' ' \ ' ■ ■■■■ "■. ' ■■ ^ ^ ■ ■ 

1. !feny student s- claimed, that . they drid not know the practices and 
« • beliefs in their area. 

2. Many students patronized and' stereotyped village thinking. 

. 3\ ^llany students felt that only stuSenjre were clever enough to 

.deal with modpm technology. ' / ; ' 

4. Many students had become so indoctrinated with the dogma of 
standard school explanations that they were* not willing to 
/.try out new ideas. . 

• " - ' ' . ■ ■ ' " ' " . •■ ' . ■ 

Intferpre tat ions 

The 'investigator concluded that the "Environmental Phenomena ^Attitude 
Scale" was a valid. reliable instrumetit and that it .was useful for compara- 
tive studies. Also;, significant attitude differences existed . between high 
school students and villagers. PurtTier, the formal educational system has 
'had a significant degree of success in shifting attitudes. toward the. po.si- 
tive end .of the continuxim; and that ^educational planners rightly should be 

i ' , . ■ - * ■ ' . ■ ' ■ ' ■■ 

concerned about the "significant attitudinal gap between the student and ^ the 
minimally educated. ^ © 



, • - ; ABSTRACTOR'S ANALYSIS 

v.; ,v/ . ■ ' ■. . ^ • 

Developing countfcies do not have either funds or expertise to plan^ahd 

^develop curriculum uniqjiely .fitted to their specific needs. Even a modest 

iocali^atrion of curriculum is in. many instances more than can be managed 

by local school authorities. Their alternatives aire- two: 1) Continue " 
i . 

their illiteracy or 2) Use materials;^ developed in the Western world. 

Illiteracy must 'be eliminated, . Therefore, . students axe. rushed into curric- 

iilar studies that are radically different from anything the adult population 

has experienced. What effects will this action have or^ the -culture? 

i)eveioping countries around the world are modetmizing their schools and 

their curricula. Very few studies of the effect of modernizing (efforts ^ 

have been made. Therefore, the Maddock eff-ort which is one of the few 

studies of* the local effects ^of new science ctttxicula In ^ developing • 

country, becomes quite important, . ^ * . 

Professor Haddock's initial effort was the development of the Environmental 
Phenomena Attitude Scale to the point where it could be reliably ad^nis- 
tered by interview in four languages. The development of the in^/rximent 
was only briefly described in these papers because it was the subject of 
earlier papers (1,2). Persons finding Haddock's effort interesting will 
vant ta study these earlier papers ^ The fact Jilmt students demonstrated 
a significantly mc?re positive attitude, towards in^s^ control and 

manipulation was reported because it STLipport:ed a construct derived from 
anthropological studies which thereby became additional evidence support- 
ing the constrTjct validity" of the instrument , ^ 

The^fact that significant differences in scores could not be attributed to 
a regional effect (coastal vs, highland) or an urban-rural effect was at 
least partially e:q)lainable, .Haddock indicated that serious attempts wer^ 
made to make .sure that the samples were as representative as possible. . 
However, he reported that it ^ was necessary to use volunteers. It is 
possible that volunteers would volxmteer because they already had a more . 
positive attitude on the dimensions being studied. That being a possi- 
bility, it may be safe to rlrif er that the 4if ferences* in attitude b^etweeri 
the students and the minimally educated may be even ."greater than the highly 
significant difference reported. Hence, one may well want to encourage 



early implementation of adult education *ef forts under the' assumption that* 
gaps between gene^f^ 
of social problems. 



gaps between gerre^a^ons are too wide, and could lead- to the development 



The first study -supported a claim that^he educational system (not only . 

V science) was influencing the development of a , more pt)sitive attitude • 
towards investigation, control, and manipulation of natural phenomena than 
was the lack of formal school education. The second study may wellvbemore 
significant in that it permitted the conclusion that there was a signifi- 
cant difference between student sV scores and scores that they predicted 
for the minijJi^lly educ.ated and a significant difference between the s^d^ 
ents' predicted and a^ctual 'achievement scores of the minimally educated. 
Examination of the means permits' the conclusion that tlie students 
predicted (incorrectly) that the minimally educated would 5core signifi- 

, cantly* lower ^ When this is coupled with other student interview infoirma- 
tion whicli caused the investigator to conclude that the students' 
descriptions bf villagers "revealed a staggering degree of patronizing 
stereotyping of village thinking/' onfe can understand the cause for 
concern, • 



There is evidence to suggest that schools cause students to view at least 
-these dimensions of seienceVmore positively than the minimally educated 
person. Hence, in that respect, the schools can be credited! However, 
it can also be argued ^b^jat the schools fail to help the students. visualize 
and understand the positive aspects of their bulture. Hence, the ^ schools 
are JFailing, 



Certainly one must support the preparers of the five-year plan who are 
calling for adult education. One. should also demand revision of student 
cxxrrictila to include intensive study of the local culture, especially 
those aspetts of the- cul'etire within the dimensions of this study, 

ThWe is a gap,- and it was beautifully exposed by the investigator- • If - 
ellMnating this gap becomes 'an objective, one would hope that all remember 
that both Khe Students and the minimally strained mus^ become the o1>jective 
of training. 



\ 



Few couatries will- be able to offer massive curriculum development efforts 
Economically, at least^ superficially, adapting and adopting Western- 
developed curriculum may be .more prudent. However, curri,culum developers 
ini^deyeloping cbuntries are urged" to proceed with caution. Ab^e. all, we 
must remember that the existing culture has been successful. It is the 
prodiict of local evolutionary processes. It has, until recently, adapted. 
Parts of the culture^ probably large parts, must be preserved.' v 



Filially, we shdtild mention future research directions. .This ^stxidy illus- 
trated one effect of change that was only partially beneficial and exposed 
dimensions that need treatment. Similar studies should be conducted ' 
wherever innovations are replacing existing cult inral practices. 
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Purposfe ■•.■.'*'*' ' . . , -r 

The purpose of this study xras to investigate the value orientations (orefer- 
ence for humanistic, technological or theoretical aspects of science) of 
teachers and students of chemistry wijth rddpect to characcferistics of those 
groups* The following relationships were* explored: / 

1, the correlation betwee«i--yalue orientations measured on a developed 
instrument and .studejit; characteristics of measured intelligence, 
general academic average, and chemistry grade; 

2* differences between the means of the valu^Sorientations for male 
and female students; . .\ 

3. differences betweein th« mean's of the value orientations for 
■- ' , teachers and students; - 

d^ifferences in the mean value orientations of teachers rela^ted to 
levels of university chemistry preparation and levels of teaching 
I; experience; 

^ ■ ^ ■ ' 

V " 5. differences in the mean value orientations of those teachers xsrLth 
^ a maximum of five university chemistry courses who vere • teaching 
blolpgy at least quarter time and those teachers with similar 
preparation who were not teaching biology at least quarter time. 

Rationale " . . . * • ^ 

This work does not appear to be specifically related to other previous ^ 
research. It rests on the- assumptions tfiat science (i.e., chemistry) 
curricula should reflect the value orientations of students, and that the - 
science (chemistry) curriculum is heavily based on a theoretical orientatioa 



A further assimption is that it is pbssiTsle to separate anjd measure the 
humanistic, techiiological, ^nd * theoretical aspects of science, 

' ■ ■ ■ . '■ , ■ ■ .■ " ■ ■ ■ - 

Research Design and Procedures 

The author used a survey design (npn-experimehtal an d non-quasi experlmentai) 
in an attempt to describe a part of the educational context, , ^ * 

Inst^ncneht >. ... *. 

The author ^signed, tested,, and -utilized a forced choice ranking instrument 
to measure value, orientations of teachers/students. The instrxjment^^cojisisted 
of an uiispecified number of statements of chemical fact, each of which was 
follQ^d by three further related^ (correct), facts. Of the three related 
facts, one had a theoretical, one a humanistic, and one a technological 
emphasis. From the three examples-^isted in ?the , article, the prientation' 
statements appeared to be placed in random order. ' 

$ ..... . . ■ V 

First preference rankings were accorded a score of two points, and second 
preference a score of one point. Students/teachers were instructed to rank 
.each set of alternatives according to their personal .pr^erence or idea b^ . 
importance, assuming ail statements were^ correct. Points were sumided for 
all sets of alternatives, providing 'three scores for each person which indi- 
cated- the strength of , their orientation to each velue, 

■'. ■ - ^ , ~ ' ' ' ■ ■ . " " r 

Test items were pret-ested on a "similar*' (but unspecified) population.. 
Content validity was checked by a,.panel of five experts (unidentified) at 
•an "Sa percent agreement level-. Construct validity 'was supported by mean 
value orientations reported for groups of theology. and%ngineering students 
(theology students scQfred hig^^er W humanistic and lower oh theoretical 
orientations; scores on technological orientations for the two groups were 
similar). Moderately high, statistical reliability was reported for teachers 
and for students and each orientation; 

SconpZe - ' . - ' • 

The student sample consisted of 60 girls and 60 boys in a suburban London, 
^Jntarlo, school. All styidents were from the middle socioecoiiomic level, had 



had three years of high school science, were ±n the uppar two-thirds of 
. their; classes academically , and were about the* same age (d.e^. , all were 
12tll grade). Data on students CfrOTi school records) included IQ scores, 
gradieis In chemistry, .but not previous science grades, : 

The teafchef sample consisfed of all 3^9 teachers teaching chemistry in the ' 

I . . * ' ' ' " \ - 

above school system in the 1970-71 school year.* Teachers provided self- 

' -'"J • • . ' 

report data on years of , teaching experience, number of university l^val. 
chemistry .courses, chemistry and biology teach iitg assignments, Na break- 
down on length ^of time since university work, age, or sex of teachers was 
reported, nor was tl 
matter assignments. 



reported, nor was there, any %xt<^±6at±pn o£ teacher participation in subject 



J. 



Proaedzire - , / 



The instrument was administered to students during one class period at an^ 
.unspecified time pf the^ schobl year . No information^ Was provided regarding 
the procedure for adpiinistration of the instrument to teachers. No. descrip- 
tion of the chemistry curriculum in' use in th& system was provided. ' « 

Correlation coefficients between value orientation scores and -student char- 
acteristics wete calculated. Differences in the peans for various blocking 
variables were tested for significance with a t-test. 



Findings 



No raw data (tables of correlation coefficients, means vf or groups, standard 
devia^:±oh^) or inferential statistics were included, in the paper. The author 
dl<i report the following qualitative findings.: 

1. "No correlation" between vklue orientation and measured intelli- 
gence, general academic- average, or chemistry- grade, for students. 

Z-. -^^'P^ slzni^tca^^^ orie^ntation of girls to humanistic atid - 

boys to technological omenta t ions. - • 

3, Students were^ "more hlgh:!^'; oriented to humanistic and technologi- 
cal values than were teachers, who preferred the theoretical. 



4. When teachers were blockedei^ two levfels of experience and two 
levels of chemistry course work: V 



.—higher ^xiiverslty preparation was associated 'with' higher 
theoretical and lower humanistic and technological* orienta- 
• ^ons, and vice versa. ^ • \^ 

— higher level of 'teaching eicperidhce was associated wlith l^wer 

theoretical and higher humanistic and technological or length- 
: tlonsV'and vice versa. ^ " \ 

■ . - ^ ■ :■ - ■ ' ■ ■ ■ ■■ 

These riMults were not statistically significant unless both 
factors wibre combined. / 

,5, Teachers who taught at .Ijeast one quarter time biology had lower 

theoretijca.l and higher htnaanlstic and techriologicjal orientations • 
than had the teachers who taught only chemistry * -'^ 



Interpretations .' ' \ ' ^ • / 

The foilpwlng^lJlterpretation^ ; ^ 

• 1. Value orientations, ol students 

do not correlate with studept characteristics. ^ • 

■ J ' ■ ■■ .fl . 

2. Sex differences for students conform to a^rommoh stereotype; the 
source is still uTjdetemined ^societal expectation vs. fundamental 
difference). ' " 

»• 

3. Chemistry curricula coincide more closely to value orientation of 
teachers' rather than with those of students, * implying a need f or v 

^ revision to match those of students. "\ • - * 

4. No causality could Jbe Inferred from results of teaching experience 
and level of preparation since these factors might be confounded. ^ 

5. Na Implications coul4 be drawn from differences in t^achi^g assign-' 
meiits, sippe comparisons with other subject matter assignments were 

\ not available. ^ - t ■ ^ 




. ' abstractor's' ANALYSIS 
Validity ' v . • ' - ^ 



The author has designed .an instrument that apparently can measure the human- 
istic, technological, a&d thfeoreJtical value orientations of individuals 
^owardj chemistry. He made appropriate efforts to control viriables-ln his- 
sample's. - Some addftipnal information on the samples/inst^ic^nts might' have 
■been tfseful (see sect Ipn 3, above) ,s^ut for the sfcaofed purposes of £he paper,, 
inforn^tlon was geijerally^satlsfact3;>ry. '•. " " - 



A major validity question arises, however," from the lack of data reported 
within the paper. Since the author does^not include correlation coeffi- 

. clents, meansj'and standard deviations for groups, levels of signi:^cance,. 
etc. , ,the reader is left with questions as to what was actually found and 

. caiuiot' judge whether, reported conclus^ns are actually warranted. 

The validity^f one, assumption Is' b or not currl<^ 

ula must match the.: value orientatiohs of Students. Can it "not klso be 
argued that the purpose of ^ducatlbh- Is to intervene in the values of 
studentsjafid to offer them new options? It is not clear what the optimum 
Satch ^lir or lentat ion la^ht ^be in order to develop maximim^nt ere^i?' on the 
part of students. The actual curriculum that students in' this study had 
been eacposed to has not_ been discussed by the" author, nor is there any indi- 
cation what its orientation might b§. 



Resjearoh Design ^ , . ' . - * . . , . 

This ^tudy comes under the- rubric of descriptlve research; i.e.-. it does not 
attempt to manipulate ah instructional situation but to discover some impor- 
tant and meaningful facets of that situation. As such, it is extremely y\ 
susceptible to biases inherent in the research questions ^sked. 

• ■ * *■ . * '■ . 
Thi^'study purports to ask whether students (assumed to, be naive learners ot 
^science) possess a theoretical, \naanittic, or , technt)logical orientation with 
respect to chemical' content. Their responses to the forced choice rankings 
are. then compared to responses of teachers of chemistry. Means fox groups 



of teachers with different characteristics are also compared with one 
another. The .cjitica^. .)3.uestion which comes .to nind is: to what extent 
are responses dependfent upon chemical knowledge? To what extent can naive* 
learners of science with little theoretical knowledge' and few experiences 
with chemical theory prefer a jtheoretical value? The answer seems pre- ' 
determined:^ students and teachers with less knowledge and exposure' to 
scientific theory. -will .prefer orientations other than the theoretical wKen 
compared to those teachers who have had extensive exposure to" the "correct" 
and V'expected" theoVetical orientation iJ^ college chemistry' classes . 

' - \ ' ^ 4t ' 

■ ' ) • 

O . 

/ y = . 

The same problem applies to the attempted construct validity in Table 1, 
Again, exposure to more of the accepted theoretical /orientation lA science 



clashes by engliieerlns science students might accoiMt for the differences . 
In means for. them compared to theology students. 

There is also a question whether one should expect any correlation between 
intelligence, general academic svera^/t^d chemistry' grade xcdth a theoreti- 
cal orientation. What is lacking is a theoretical construct- which could 
explain such correlations, even if found. Further, vas there any question- 
In the reader's mind that an abstract, theoretical .chemistry curriculum 
would jiot reflect teachers' Values- rather thai? .students? ' Examples of learner 
oriented s<rience courses Are rJ^re l^eed, : ' / ' 

In the ..case of male vs^female student diff€±ences In values., the iatter's 
preference^ for humanistic orien^^ation is readily expl^^ned, by sbcietal 
expectations. that females will be people oriented.. ■ Again, we' have learned- .V -v, 
nothing new. What might have beep Interesting to "^f Ind out is whether or. : 
not .^te^cliers of both sexes with sliiilar' acad^ chemical;,backgro.und differ 
in tnelr* .value orlentat;ions', ' / v , > ; .. ^^ - 

Since no constn^ct is pt^esented that would 'explain any ^r^lat ions hip ©f 
teaching asslgmaent to v^lue orientation, this hypt>thesls Contributed 
little to the ^ paper, and probably *^cpuid have begn^ 

« \ • « •• • • ■ .. • , • . ■ 



AdequjOLcy of'tJie Written Report ' - ' * v . 

Some of the difficultiels mentioned above^may, be due in part to the origin 
of .the study— the author's dissertation. IJhat Is presented here is a part 
of a larger wrk, whose natii^fe is suggested by the thesis title. It nay ' 
have been pertinent in the thesis to block on teaching assignments /partic- 
ularly when considering learning outcomes, but the inclusion of ' this aspect ^ 
.in. thi^ shorter work seems questionai>le. It is difficult to abstract a ' 
short paper from a larger and more comprehensive work. The danger is that 
one abstracts parts without providing sufficient ratlonale^or relevancy, to 
the shorter work> ' 



Suggeatioria For Future Work 



The author's suggestion that a^-temate forms of the Chemistry Preference . ' 
Evaluation Instrument^ might be used to me^^re changes in value orientation' 
points to potential further research. However,, an;^ future work:in yalue/ ; 
orientation of teachers and students should ' have ^'^ clear- n6t:ion>of purpose^' 
and value. The results should Jiav^some i^^^^ 

lemming might be organized^pr c^ducted. ' * ^ • ' 

, ^ \ • ' • ■ ■ ■ ■ ' . ■ ■ 

Any further work In' value prientatioh and its potential effect on curriculum 
should, have a stronger conceptual b^se. . What -questions are worth seeking 
ansi^ers' to? Is one orientation better than another? Can vaj^e orientations 
be changed by exposure to more sdience" information? By exposure to differ-* 
~€nt types of curricula? If cognitive level- (i.e. .. knowledge of chemical ; • 

theory of /a theoretical nature) is contrplled,. how do we explain value. • 
»brieijtation preferences? ^^^^se pxeferenceis stable oVer time? Asking ' 

stronger quest ions, might -generate more educationally significant results. 
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^Purpose • 

The purpose of this investigation was to compare achievement by 119 tiigh 
school biology students after receiving instruction by either an individ- 
ualized, audio-tutprial system or by group classroom presentations. It 
was hypothesized that (a) there wo^lld be no difference in achievement on 
teacher constructed unit tests; (b) there wbuld be no significant differ- 
ence In the correlation between scores on selected predictor variables 
and. achievement the two treatment groups; and (c) there would be no ; 
significant difference in achiev^pent between/ the treatment groups as ' 
stibdivided at the fortieth percentile on national norms fo^ selected 
predictor variables. 



, ' Raticfele - 

The . concern of the ' 'investigation, fociises upon ^ in most 

higji school science courses— how-to effectively deal with student differ- 
ences In. reading: ability^ vetial aifility, and the ability to use quanti- 
tative information. jSmallgrou^ or individualized instruction as 
described by PostlethwaitV Novak a)c^^ Murray (1^69> and others, seems to 
y ■ /o^^'^T^- classroom dilemma, since it has 

■ already been establi^^ stxategies cah be effec- 

- tjve wheip utilized with a selected pppulitioh of learners at >the college 
and- secondary school levels. When standardized meal^res.' employed (Otis / 
I.Q., SCAT, SAT) failed to predict differences in student achievento 
; between t^^ two treatment ^oups it was hypothesized by the authors that . 
' the audio-tutorial metliod of iiistruct ion. might be providing an alternative 
^ : • : - .for studilts. deficient' in.certaln skills (reading, quantative Abilities). 



Research Design and Procedure 



Two randoitoly selected treatment groups (n =59) were taught mitosis, ' ^ 
meioses, probability , and genetics using materials developed by the high 
school teachers in collaboration with the senior authors. During a 
treatment period of three weeks duration, one group (AT) received all ' 
Instruction #aate.rial by an individualized, audio-tutorial format, while 
- the other group (NAT) was taught using a group, classroom/format . The-' 
hyj>othesis tested were as follows: 

• 1. ■ . (Ho:XAT-.= XNAT, % :XAT ^ WAT) 

No significant difference in achievement^^ 

2. (Ho:r AT = r NAT, Hi: r AT ^ r NAT) 

No significant difference in correlation between scores 

or selected predictor- variables and achievement. ' 

3. (Ho:XAT 4ath% = XNAT 40th% 

:■' ■ Hi:XAT 40th%: XnIt 4qth%: XAT 40th% .XNAT 40thZ) - r. , ■ 

* No significantvdixference in achievement between treatment groups 
as subdivided at f Tie 40th pefceiitile on nationals norms for' each • 
predictor variable (SCAT qxiantitative, verbal, total; Otis IQ; 

STEP reading; SAT Language, Arith. app,, para, meaiiing.) ' 

■ ■,' ' ■ -■■ ■ - • ■ • ■ ' 

■ ' ■ ■ ■ * . ' ' * ■ . • • . ^ ■ • -5. ■ 

Findings ■ . ' * 

Hypothesis One : Hp was. not rejected as no significant difference in 
achievement .\^as found usingr a pooled vari ^ 

^ Hypothesis Two : Hb was rejected for^^il^predictor variables Wcepi; 
the SCAT quantitative as a result of the application of the Fisher z 
statistic^ ' , ' 

. . Hypothesis Three : ^Ho was not rejected for every pr^'dlrroy v;^r-fa>ilo' -Tn 
the popul*:ion above the 40th percentile . Ho was rejected : for every predxc 
tor variable except the SCAff qiianjtitative in the population at or below the- 
40th percentile. * . , , » , 



Based upon the data and the results of statistical analysis, the follow- 
ing were reported: . 

!• The audio-tutorial group had higher mean scores on the teacher- 
made unit tests although the differences in achievement' between 
the^ two groups so measured was not significant. ' 

• ■ . i 

2. Standardized measures were less predictive of achievement for 

the groups taught by the aucfio- tutorial format, 

3. When the treatment groups were subdivided at the 40th percentile 
level for each predictor variable, no significant differences 
were found in the. ability of the variables to predict • achievement 
for subjects scoring above the 40 th percentile. 

There was a significant difference between the treatment groups 
in the ability of the standardized measures (excepting for the 
SCAT quantitative) to predict achievement for subjects scoring 
' at or below the 40tTi percentile. . 



Interpretation - 
It was reported by the investigators that tb^ marked contrast in the 



ability of the standardized ^measures to .pre^jtE^ achievement among individ- 



uals below the 40th percentile "^ould seem to iw^rt the individualized 
audio-tutorial method as a meaningful alternative fbr students possessing 




3i 



xiertain deficiencies . " 



ABSTRACTOR VS ANALYSIS 



The preceding s^^^^^ points up one of the weaknesses of the study-^namely, 

thej.ack af a discussion of implications of , the study in the context of - 
. \previous' work* by others. .'For example, Pihsky (1973) reported that students • 
whose iearniiig activities were c greatest ga.ins 

In achievement. Inasmuch as the audio-tutorial procedures! may- h,ave 



considtt^abl'e control on the learning activities of the AT group members > 
■some discussion of this factor would seem -appropriate, particularly in 
view of the performance of the group at or below the 40th percentile* 
A further clarification would also seem to be needed regarding the 
instructional styles and roles of the two teachei^in each of the AT 
NAT gtbups. 

* ..1 . _ * , ^ " . ■ . 

Perhaps because of space' limitations, the authors provide no insist into 
the instructional strategies employed with the NAT group. It would seem 
very unsafe to make predictions concerning appropriateness of use of audio- 
tutorial instruction in lieu of other teaching strategies without clearly 
delineating the similarities and differences that prevail between the two 
programs. It does not appear that the two^. authors are reporting anything 
new regarding the abilit^i^^f individualized, audio-tutorial instruction to 
successfully teach science concepts. It may be\ however ^ that the mater- • 
ials utilized are of a unique design which may provide benefits to some 
students receiving instriaction in some specific areas of higlj school biology. 

The concise manner in which the' study was reported obviously leaves /some 
questions unstaiswered rei^ardi^g, the data: "analysis . " For exanple, the authors- . 
used a't-test "to verify the effectiveness "bf the randoru^ationyprpcedures." 
If , In^ed, the procedures' used for assignment to gxb tips _was truly random, 
no verification -would be required! Although this extra precautioi^was taken-, 
^no statement is provided as to which standard measures were used as a base 
for comparison. If they were, the samej ones as used for selection of th^ 
groups falling below and above the 40th percentile, a substantial burden 
has been placed upon the validity and reliability of scores on those . / - 
standard measu^^, ' • " 

If this is the case, then questions iregarding date of testing, eqxiivalence 
test- forms, the previous student experiences in school (grade level) need 
to be focused upon. For^ example, the authors make re:^erence to students 
in 'grades 9 through 12. What assumptions were made regarding equality of 
subject naivete among the AT and NAT group members? How* does the analysis 
account for different experiences of twelfth grade students as^con^aired to 
ninth graders? Obyipusly the latter will have had fewer opportunities for 
instruction in the content areas which, were incliided in the materials used ^ 
in the study. In short, for a three-week period of training in ah area 



that is specifically ' science oriente-d, predictors of the type used <Otis 
IQ, SAT, STEP, SCAT) may not be as appropriate wheu used alone, ^^s would 
previoys experience and achievement in related subject matter content. 
The final results of the study inay be as much due to a qualitative differ 
ence in the students as in the AT versus NAT difference. Any trend 
established prior to the experimental period may have had considerable 
influence on th^<^estilts reported « » 

The criticisms cited in no way are designed to reflect negatively upon th* 
authors or the reported study ^ 'Given the constraints of the real world 
of schools, classes, and policies of research journals, the study as 
^reported does provide some added insight into a substantial problem in 
the teaching of biology In our nation's schools . 
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Purpose 



The purpose of this study was to analyze the. outcomes pf two methods of 
instruction, convenjbional lecture-laboratory and audio-tutorial, as 
related to immediate achievement and to retention among students in a 
university course in animal b;iology. The following two research questions 
were examined: 1) Will students in an audio-tutorial program show greater 
immediate achievement than those in conventional lecture-laboratory pro- 
grams? 2) Will students in an audio-tutorial program show greater 
differences in: the retention level than those in a conventional lecture- 
laboratory program? . 



Rationale 

As the authors correctly indicate, the .audio-tutorial aipproach to instruc- 
tion has grown into a widely accepted teaching method and has been used at 
^every level of Instruction— elementary school througjti graduate and prof es- 
sionafiL school. It -appears that the rationale for conducting this study 
was to provide instructors with some data useful in selecting between two 
separate formats of instruction. 



Research Design and Procedure 



The experimental group (n = 134) participated in an audio-tutorial program 
"^ich consisted of '18 separate exercises which were develoi^ed and tecorded 
on.cassette tapes. The entire taped lecture sequence . required approxi- 
mately 15 hours, with individual exercises ranging in length from 15 to 85 
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minutes. The progr:aTn- also included, vpliintary group .discussions orice a 
weelc and assistance from graduate studenJpK or faculty members when, needed* 
The coTxtrol group (n =. 19(5) consisted of two conventional lecture- 
^iaboratory sections,/^each of which met for four 50-minute lecture sessions 
and-one three-hour laboratory session a week. Students enrolleS'^in one or 
the other of these two groups without realizing that two separate methods 
J of . instrucfe-ion were available. The afternoon session was randomly 
^selected -as the experimental section. ^ - • . 

An achievement test consisting' of 60 multiple choice items was developed 
and used as a Hrretest, posttest, and retention data gathering instrument. 
A reliability lof . 86 was determined through the use of the split--half 
V method arid the Spearman-Brown formula, and the content validity was estab- 
lished by a panel of qualified individuals. The professors itivolved in 
the study did not participate in the construction or validation of' the' 
achievement test and they had no knowledge of its contents. . / / 

" The pretext was. administered to all of the students on; the- first day of * 
the quarter and again at the coii5)le^ ion: of i the quarter. Eleven weeks and 
three days later the same jtest was a^ain administe^d to all of the avail- 
able students. (Twenty-nine percent of the control group and 34 percent 
of the experimental group participated in the retention study.) Five t- 
tests were conducted in the analysis of the data. 



Findings 

The. pretest scores for the two groups were not significantly different; 
however, the posttest scores and the retention scores were significantly 
different with the experimental ^group being higher in both instances. 



Interpretations ; , 

. ' . . . ' • . . . _ . , _ 

Ho specific conclusions were stated. However, it was implied that the 

audio- tutorial approach to teaching college biology was superior to the 

conventional methods of Instruction with respect to both immediate achieve- 

iQMit arid retention. ' 
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ABSTRACTOR'S ANALYSIS 

■ ,^ • . ■■ ■•" . ' ■■ ■ . . ■ . . •• . . ' ' ■ ' 

Today there are several differentjdegrees of axidio-tutorial sophistication; 

however, Postlethwait (19 70) ^states that the audio-tutorial system was 
beean in. 1961 as an attempt to assist Purdue University students who had ' 
a/poor background in introductory botany. This method of instruction 
began a'k a tap^ lecture and was later supplemented with a textbookV labor- 
atory manual, specimens, experimented equit)ment and other such items. 
Postlethwait^ s sysiem theri evolved into a much more elaborate and inte- 
' grated program, >3^iKh now -incluijes seve sessions a week, an 

. lndepetiden^^'stj>dy^essiQn,^^y'^^^ assembly session, and an integtated 

. quiz session tl96S 

Tlie audio- tutorial program which Ro^sey and Mason used as a basis of their 
sttjdy appears to be similar to Postlethwait 's earlier program as it does 
not contzain the numerous elements of Postlethwait 's lati^r, more integrated 
approach. Recognizing .tfiis difference, one could speculate that a repli- 
cation of this study lising a more integrated audio-tutorial approach woxild 
result in even greater differences between the control and experimental 
groups. ' I. 



.In their review of literature Rowsey BpA Mason mentioned eight related 
studies; however, two of these studies (Weaver and Russell) were oitiitted 
from the reference l^.s^at the end of the article. The absence' of a 
correct reference to Russell *s work is especially frustrating as it is 
the only study inentloned which demonstrated that students taught by the 
conventional lecture- laboratory method of instruction achieved at a level, 
significantly greater than students instructed by an andip^tutor ial pro- 
gram. . . ." . 



As Rowsey and ^las on *s, literature' reviw demonstrated, the audio-tutorial 
instructional apprMjj^fciafe produced^ conflicting findings, and an expan- 
sion of the literat^^Preview will not tota^lly resolve the issue.* Stud 
by Meleca (1970, HjPIt and kolt (1973), Hahn (1971) , and Bish, Bowman W 
Sarachek (1978) support the superiority of audio- tutorial approaches over 
a more conventional method. However, studies by Durst (1968), and by 
Grobe and Stur3e:3 (1973) do not support the superiority of the AT method. 
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it appears that future inviestigations comparing the audio-tutorial instruc- 
tional method with other methods would do x^ell to devote ..some additional 
thought' to the reasons /for the conflicting findings reported in the liter- 
ature. One approach would be.^to further refine the research design and 
apply statistical techniques^usef ul in identifying the vairiables relevant 
to a student's learning in these approaches to instruction. Bish, Bowman,' 
.^d Sar^chek (1978) have begun this, and th^y' report that of 18 variables 
studied only the pret^urse test score ,^^prf!urse section CAT or LL) , and 
class contact time are significant predictors of student performance in 
the coilfse. - A' relatec? approach which could also be attempted is that of 
usingl Hunt's ioaatchfng models •t;Q|(Ecept- (1971) . He describes in detail the 
necessity of matching an** individual with the "correct" educational environ- 
ment.^ If this were properly done, we would expect to observe jgreater 
achievement in all types of learning programs. 




Pare and Butzow (1975). examined the relatioil^aMi Miong independence of' work 
habits, attitude, and achievement in an audio-tutorial physical science 
course. They conclude that audio-tutorial instruction does not appear to 
,be a panada for all students and that poxe research on . this instructional 
meithod is necessary before we will understand all of the related param^teri. 

Rowsey and Mason seem to ignore variableis such as learning styles, attitudeis 
work habits and etc. when coB5>aring the experimental^ and coiitrol, groups. 
Based upon similar pretest measures (cognitive scores) , they state that 
their two' groups were "homogeneous" at the beginning of the study. 'Werie 
^ the. groups homogeneous with respefct' to otJier relevant variables? If not, 
what effect, if any, would this have on the study? " . . 

Since long-term retention JLs a significant part of one's education,' tire 
measurement of retention is indeed important. However, the number of 
students participating -in the retention portion of this study is of some 
concern. * , 

Why was this nijmber so small? Was *th6re some type of bias operating? For 
cxiample, could it be th^t several of .the original participants did not 
return to school in the fall due to low academic records? If sb, this could 
introduce bias and make interpretation and generalization very^diff icult , 
if not Impossible. . 



In addition to the suggestions made earlier for future research, one addi^r- 
tional area sfhould be mentioned . That is, rese^;?c:fi' ^elated to video- 
autptutorial inBtruction. Fisher, Bue^ither, ' an^ Macwhiiiney (197 7>, have 
begun to examine this area*^and they conclude that video-autotutorial 
iristruction seems to be a partictilarly effective' method of instruction* 
In;yiWw of the increasing availability of VTg. equipment, this area of^ 
research deserves additional study. V 
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